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ABSTRACT 


Pome Uoe ose investigates the utility cf figuretive 
symctology for tactical situation displays. The purpcse was 
oma. .OhMeNeee Lie nore s@ descriptive SYmMbOlo2 yeni ieunative 
meee re2=y CF use cr more lifelike images to represent 
targets--would enhance evaluation of a tactical situation 
emiay, leew,  eCnadlie tne user to more rapidly assimilate 
SiemecVdluawes a tactical Situation display. Basis —or 
ecmparison was the Navy Tactical Display System (NTDS). 
meeecuricalty, Experiments us@d in our research tincluded 
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Comear isons Of monochromatic NTLS, color NTDS, and color 
figurative symbolcgies. 

The analysis of the data obtained from the experiments 
suggests color symbology is significantly better than 
menochromatic symbology and figurative is tetter than NTCS 
symbology. Specifically, color figurative(green/red) was 
determined to oe opest, followed in order DY, Coron 


tigurative(blue/orange), color NTDS, then monochroratic 


eater. 
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A. BACKGROUND 

Pee Use Ofemilitary symbols dates back at least to the 
eoms Ot Narolecn. warfare has changed considerably since 
that @ra and so have the methods by which the battletield 
Biiemronmert is graphically portrayed. [Ref.1] The wars of 
Meroe ryedr were very localized. Battlefields were often of a 
size tnat permitted a commander tec view the entire battle 
area from a hilltop vantage point. Unaer these conditions, a 
moummamaer COUid track ail of his activity with a tatle-top 
Situation display. The geographical area portrayed was 
Small, and the number of symbols required to indicate 
Semivity waS Micimal. Rapid mevemert cf units was a rare 
Eaemige sO trequent updating of the display was nota 
requirement. Now, with mechanized infantry, armor, missile 
mig rocket installations, supersonic aircraft, airmobdile 
MuitGsmemultipurpose naval vessels, etc., the variety sec 


sympols required has greatly proliferated. ([Ref.2] 


BemeiloltORICAL PERSPECTIVE 

“Military commanders throughout history have faced the 
Maewmeemec. controlling their tcrces Yor decisive application 
Peel tery power, with the objectives of echieving ~e 
meewmeeaqee enysical action at a fparticular location data 


determined time and c* getting information back abcut the 








outcome.  [Ref.5] In the first documented tires of early 
warfare, battle commanders sought a high hill or other 
Vantage pcint zrcm which to view the pvattle’s progress. They 
ee wbed Varlo0us Weans of Lroviding the communications wita 
woecme tO Ccemmard torces: mirrore, flags, harps, horns, 
drums, and even messengers. ([Ret.4] Information teedbdack to 
the commander was thrceugh direct cbdservation and commands 
Someaepe issued or reissued in time to direct/redirect 
Yorces. AS the geographical scope of warfare and the 
fobilaty of forces increased, the ability to instrument the 
Pore iA such a way that a coherent picture of it could be 
Transmitted to a remcte ccmmander, and the communications 
MHeeeoocry tO trensmit a tirely picture, failed to keep 
rece. [Ret.4] Lana torce commanders began to move tlags 
Sieent On charts or sénd tables, using bits and pieces of 
Paper rigence information about enemy disposition and 
Pwerational reports from friendly forces. Naval commanders 
fMeeage similar methods, as did Air Defense commanders t60 try 
Memmew2atch dnd control thelr forces. The cemmander with tne 
fost accurate and tirely HIG Oy ie fjers) 1 al fe) ist and the best 
ccmmunications tc Support “intormation “ficw showld ce 
successful in his pursuit. [Ref.4] 

Ise process Of BZenerating, disseminating, and dgieestuae 
ieeepmation became an important pert of the formule for 
Bimecess. #1th the growing appetite for iutorration came 


redar. |The air detense commander was no lenger dependent 





upon ground observer or comdat patrol rerorts for vital 
intormation on enemy aircraft zosition or velocity. ([(Ret.4] 
he could determine the location of {rlenagiveeclwerart Jame 
cculad now see the air battle coherently and control his 
zscrees. Certainly radar was no panacea for ‘f“erce contre! 
bE€cause rédaars were not easily relocatea, they were strictly 
Petes c rss snt, and eventually the enemy developed 
CepemeartiecSs to easily dam the rader. Attempts to first 
exploit the radar resulted in manval control centers. One cf 
the first examples of a manual control center was thet of 
the Strategic Air Command (SAC). SAC’S mission required the 
Fest edavanced command and control system rpossible. The 
global nature ot SAC’s mission made it imperative to meet 
medmeeccrve problems caused by distence, honer the need for 
feeeey ana security of instruction, and keer track of 
thetsands of minute details. Large display ooards were used 
Mommedekxedll fOrce activity. Current positions of all enemy 
Someecrtenaiy units were painstakingly plctted. Large display 
womeis, TOounted on trolleys, consisted of plastic covered 
Paeemmcomde were used by ccmmandéerS to direct the force. Battle 
Tiemeemrechmicians clotted new intormation on thes@ charts as 
it became availatle. iRet.S Later a switch was made tc 
~eoaemamen; tiluminated tlastic display creas where reverse 


Peelers ese  COoUlc be acccmplisned and would not cEStmuct tre 


lege toe force directors. This system cf plotting display 


Seemetceee Ss Still used todey. This system .servea its purnvoses 





well; however, it was slow 6nd cumbersome. “Since it 


Moores ented tne apogee of a fmanvtal system, automated 


rs 


fu 


csistance wes imperative. [Rer.5 

In the Late 1949°s5 there was a Black Box approacn to 
ccmmand and ccrtircl requirements. Equipment was developed 
ag@ecroducea for specific polications aid Wiltmikes or mo 
ccnsideration was egiven to environment. Sccn tlack btoxes 
Siememue- Ne gesigned to interface with black boxes, but the 
fedqeemecreaktnrouen came with the advent ct the ccmputer. ‘ew 
the radar systems coulc de tully exploited. ‘The computer 
eemeres Improve the ccherence cf the radar picture ot the air 
eeeeres oy performing many cf the processes which humans hed 
Moeomeaoing ifpertectiy. Calculation cf neading and speed, 
Covimmee Fiom cf intercent sclutions, remembering the identity 
Seivcdme Moving targets-~all or these precesses and Pany 
more. The first example cf computer application ccupled 
with radar (19£7) was tne Air Force’s Semi-Automatic Ground 
Meyiimonment (SAGE) system. This system was 4 netwerk cf 
redars wee TD eommunicatioas toOr connecting and “emess— 
Cammec tings redars tc regional control centers and the North 
American Air Defense heaaquarters. [Ref.5 
Miweenesbesinning ct the 1960's, ag committee examining 
ccmmana and control concluaea that the capanpilities of our 
weapon systems had outstripzrea our ability to commanc and 
Cone Cc | THe. SEV as le ccmmdamad cenmvers <anidee Fann, 


redundant means of communications were being requiréc, wita 





ae = 


SAC and the Air Detense Command leading the way. ([(Re?.6] 
Additionally, other developments affected force management. 
mmeme size Of 4 contlict area had clearly expanded oeycnd 
line-of-sight and over-the-horizon. weapons kad greater 
Memees ead Capatility. Se€nsor coverage and capabilities 
Peete nped and required coordinetion for effective wse. The 
sone rence of Vomces gGepeuaed almost Cn Tired ¥ On 
cemmunications, data processing, and cther elecuimonercs 
woeeeeeo |) functions. Almost concurrently with this surge for 
iepcwcorinand and Control capability came the technological 
revclution. Rapid technological advances made a significant 
impact on the development ana application ot defense related 
Systems. 

“By the mid 1968s, we haa learned several hard lessons. 
CS systems could not be acquired like weareon systems. They 
hed to evolve with continuing user participation.  [Ref.6] 
maewen take. a mement to Stop and review CS evolution, we 
reccgnize that an integral part of good effective Cé is the 
control of intormation. What a great information precessor 
PeemcGomeuler was tO ve. HOweVer, there Still ‘e€xistedea 
Tmoreestumoling block--defining intormation needs. Mcderpn 
Gemputers end communications make it possitle to retrieve 
and/or rrocess an almost infinite amounot of information. 
hee teolhCUrmuch)6h6Cilnfcrmation in the system causes gFéat 
meeeesyion, end tco much detail can confuse tne cecision 


mraememare waste time at a critical pcint. In spite o% Saae@ce 


tr 
(>) 





dangers, wets me ciierG io i or Climination of validated 
infcrmaticn requirements continues to be except Lona y 
difficult. [Ref.6] This process of information distillation 
cr intormaticn ccmpression ocils down to what dces the 
commander reelly need? This simple question gives rise to 
Wany areaS that afrect the multi-faceted spectrum ond 
wWilitary operétions. It became obvious that we needed a 
system fcr aralgamating all information inputs and providing 
ccmmarders with an intcrmation display system than was 


meee scVeluated. _Cne aspect of this infcrmationgodispl ay 


Seewem — tactical situation displays ~- is addressed by this 
taesis. 
eee UE TrOSE 


During our CS Exercise Laboratory (0S375@) class at the 
Naval Pesteneutate school, the authors of this paper 
Participated in a series of experiments which attempted to 
Teeeureer nether or not infOrmation processing tasks could be 
enhanced by fresentation of information in color versus 
femechromatic. These experiments confronted subjects with 
Stetic Navel tactical situation displays. Results of these 
experiments indicated an imprcevement in performance when 
Peeeiemcolor Cisplays. AS a result of OUr farticipetion in 
these experiments, several questions developed regarding 
Syeoroey fOr targets. Wer Thought the target symbology used 
Meet tf acnilt to immediately recoznize. Specifically, wnese 


experiments were oaesed on the Navy Tactical VDisplay System 


14 








which uses symtology consisting ot circular, square, and 
rhcmbic shapes tc depict targets. Also, we considered that 
symbols could be tailored to provide more information. The 
amome CXperlence Witm Military symbols indicated that the 
eye y Or constant user of tactical Situation displays is 
Gees, tO adapt to the use ofr non-figurative or abdstract 
Beaercoucey, @.2., NTDS symbols. Use ctf these abstract 
ameoees Nas been necessitated to date because of Equisment 
Mia@itaticns. However, with the advance of technolcegy, 
mieecueerily in the areas of computer driven raster stan 
devices, it is now pessible te tailor symbolcgy te provide 
momen inhtormetion in a concise manner. With this 
Setervadtion, we postulatéd that assessment Of a tactical 
Saeemiemion display may be further enhanced using color 
figurative Syrecolory. [hls tUnesis =. £0cuses. on ines ven 


Mmesermation content fer tactical displays. 





Tl. DESCRIPTION OF FXPERIMENTS 


Bxperimenots were conaucted to test the null hypothesis 
that there is no difference between NTDS symdclcgy and 
figurative symbology. We Soeculated Chas diescripmmive 
symooleey wceuld enhance @€valtation of a tactical situation 
feeeeey, 1-.e€-., Enable the user to more rapidly assimilate 
peGeeevalUGdle ad tactical sittation display. Additionally, 
the experiments egain addressed the issue of whether or not 
Omer enhances a subjects ability tO aScuimarvave 
batormmation. This issue was expanded to include an 
assessment of wsreen/rea/white versus bdlue/orange/white to 


lmdicate friendly/hestile/unkuown forces. 


A. DEFINITIONS 

In the context of this paper, references to NTDS 
sympology are those symbols used in the NTDS system, 
particularly as used in the Warfare Environment Simulation 
(WES) game. Circular Shapes represent friendly forces, 
rhombic shapes represent hostile forces, and square shapes 
revresent forces of unknown allegiance (Figure 1). 

Morochromatic NTDS displays reter tc displays wherein 
the red end blue electron guns on the graphics display 
device were aisatled. This resulted in a display with ea 


ereén background and white symbology. 


O) 





Color NTDS symbology reters to the color symbology used 
ln the WES game. The wES game uses blue to indicate oor ema y 
mobeces, Orange tc imdicate hostile forces, and) Whaete wat oO 
Midicate forces ctf unknown allegiance. Use cf color with 
NTDS symbology results in réauadant coding of the symbols 
allegiance. 

“Figurative” symbology refers to lifelike shapes--actuel 
shapes tnat look like ships, planes, and submarines used to 
represent targets (Figure Z). 

Color figurative (bilué/orange) symbology reters to the 
Symbolcgy develcped oy the authors. The colors (clue, 
Orange, and white) match those usea in color NTDS and have 
the same meaning. 

Color figurative (green/red) symbology uses the seme 
symbols as developed tor color figurative (blue/orange) but 
Meieemenreen to represert friendly forces and red to represent 
hostile forces. White again represents unknown forces. Use 
ef green/red/white tc represent friendly/hostile/unknown 
forces was recommended by the authors of GRAPHIC DISPLAYS, A 
EUMAN ENGINEERING GUIDE FOR USING CRT COMMAND AND CONTROL 
Pires. [Ret .7] 

"Medeor Treatment. refers tO monochromatic NTDS, 


Gouporeiedo, or color figurative display techniques. 


to 


LES IGN 
Mmaonexneriments were designed. Tneir objectives#were: 


iweeomccmpare TESponse Tredcetions “TOS mMerocimomartc 


en 





NTDS displays, color NTDS displays, and color figurative 
displays. 

<¢- To compare subject’s ability to recreate a 
feeuredl displey from mrerory. 

mex periment, 1 

This experiment was designed to test and compare 
meae tou tires to ‘monochromatic NTDS displays, color NDS 
displays, color figurative (olue/orange) displays, and color 
tigurative (green/red) disriays. 

Petits @YPeriment,  tcur sets of tive tactical 
Situation displays were used (Appendix D). spe citate ines 
these displays were composed of land masses, sea, geographic 
Coordinates, and targets oriented around the aircraft 
carrier Enterprise(ENTER on displays). Each of the five 
ceecmeees had a different composition of targets and Wwaried 
in complexity frem display 1 (Y symbols) to display 5 (27 
symbols). The five displays in each mode were shown in 
random order. The monochromatic NTIS displays were exact 
Gupmmecates of “the color NIDS displays excert that the red 
and blue electrcn guns were disabled. The colcr figurative 
Mweplays were mimicks of the NTDS displays, i.e., displeys 
were replicated in all particulars except that figurative 
symbology was presented instead of NTDS symbology. To 
present the displays and query tne subjects, a sotware 
routine that had been developea by LCDR Ellen Roland for the 


OS 275@ class experiment was adapted for this experiment. 





The mechenics of the experiment had each Si) Oy ere C 
vier LOY moaces of tactical SltUvation c1S polkas: 
mronochrometic NTDS, color figurative(blue/orange), color 
NTDS, and color ftigurative(green/rea). The test was 
sammaistered tc four grcups; e€4ach group centained <¢ix 
See iects (Arpenaix A). Order of mode presentation was 
determined py the subdject’s group (Appendix B). Each mede 
moevaigead five tactical situation disrlays as previously 
described. Within each mcede, order ot opresentaticn of 
Glsplays was randorized to insure the subject received the 
a@ispieys in varying order af complexity for each treatment. 
Zach display was accompanied by six questions (Appendix C). 
TRE questions appeared at a terminal that provided immediate 
feedback. This terminal was separate from the device used 
Memeresent the tactical situation displays (Figure 3). 
Guestions required that sudjects evaluate the display 
regarding symbol type (aircratt, ship, or submarine) symbol 
allegiance (friendly, hostile, cr unknown) cr both (type and 
allegiance). Questions were repeated until the subject 
meemcma@cd correctly. [otal time until correct response Was 
mecom@ed fOr each question. The measure of effectiveness 
used ‘cr evaluaticn cY¥ the displays was total time to 


correct response for each question. 


2. experiment 2 
The second test involved presentetlon Of E1ther ac 


monoenromatic NTDS display or @ color figurative (zgreen/red) 


co 





Gey 





display Scr °@ s€ccnds. Subdjects were then asked tc attempt 
to reproduce the tactical aisplay from merory. The display 
Beem oeeXact replicaticn of display number twe used in 
experiment i. The display hada eighteen targets with the 
snoterprise in the center as a reference. 

Precedureiy, each subject was shown the display and 
Paeme Trovided a map (Figure 4) that had target locations 
marked. Individuals were asked to identity target type and 
allegiance. scoring was accomplished by awarding one point 
memmeonnect id€ntivyication cf target type and cne peint tor 
Goeaeweecy clliezliance. Maxirur tote] roints was thirty-six. 

The test was administered to two groups, each with 
twelve subjects (Appendix A). The subjects were the same as 
those that varticipated in experiment 1. The groups were 
maonoomry Structured with no Specific criterie of tacticedl 


display experience. 


fe PSU BJECTS 

Twenty-four students of the Naval Postgraduate school 
nawmpeened as subjects for the experirents. All twenty—-iour 
Vauemnilaeary Officers, 1¢@ from the Air Force, <¢ trom the 
Marine Ccros, 7 trem the Navy, and 5 from the Army. Three 
ct these subjects had extensive yprevious experience with 
meledey display systems; seven had mederate and tcurteen 
Momeebittle or 20 previous experience. Five “had i Vveviouc 


femloe Experience. All subjects were part of the Command, 


moemerel, and Commundications curriculum. 


aL 





subjects were divided into four groups ci Sige Gaeh. This 
grouping adetermined the oraer of PRESEN TatEIOr Olean odicis:. 
piemiectS were placed into grours according tc levels o* 
tecticel Situetion display experience. Zach group had a 
relatively equal mix of experience levels to minimize 
biasing due to previous experience. The order of mode 
presentaticn (Appendix 3) was changed ‘fcr each greup to 


ioemeze Confounding due tc learning effects. 


Dee ae PARATUS 

Sech of the subjects was tested using a CCNRAC video 
Pasay (Figure 3) tor projecting the tactical displ am. 
Mifjeacent tO the videc Screen, subjects were seated in front 
of an Ann Arbor terminal (video and keyboard). This 
Pemeeements is Ilscated ie the Commend, Comes Gal: and 
Communications (C3) Laboratory at the Naval Postgraduate 


SiG ie.0.).. 


B. seROCEDURES 

moe Start of Cach trial, subjects were brieved on He 
Purpose and extent of the experiments. Each was acquainted 
with both NTDS and figurative symbology. Also, the details 
wimececrion tycte, displey idiosyncrasies, and potential 
eeimeedo pLOocKsS were explained. Questions addressing the 
Pecurece! Situetion displays were presented on the Ann Arbor 
Boece Subiects reésrpondea to questions by derressine tne 


wommecermecumeer key tcllowed by a Carriage return. Jf en 





incorrect response was made, the aqvuestion would be repeatea 
until it was answered ccrrectly. When correct, the next 
eee tion Would be Wisplayec. This cycle continv@@ throwgh 
Gach distley and supsecuent mede. 

Environrentelly, suojects were tested in a darkened eréa 
meee curtretent lighting to easily reed ane recogmize all 


i 


dis 


tu 


mc. Lewels of illupinetion to include brigbtiness, 


J 


Seomtinest, and cclor were adjusted on the graphics terminal 


momomaer LO Stendardize each triel as mearly as vpessinle. 


taf 


ASSUNPTIGNS 
Meee tO resolution liritetions of .the Genisco egrenbices 
fomemec, the size of the figurative symbols aqid mot precisely 
meme n the size of the NIDS symbols. However, the slightly 
meee «6S Ze UO «€6thhe figurative symbols contributed to d@ more 
Smuetered display tha With the NITS symocls. These were 
a=Ssumed tc be counter-dalencing factors. 

pemeg Pecause of equipWent rescimiticn limitations, me 
Bevemet was made to aevelop ftiguretive symbology in a 
iWemeenurematic mede. #e assumed that cur exper imental 
mewn s  fould egain show that color displeys @ere supierzor 


Fowmenociromatic thereby crermitting comparison of color 


<j 


Eeeuretive Fersus ccler NEES. 
The measure of etfectiveness (moe) for experiment 1, 


[eer Suc )eCt respensé time, May not re tne ideal methcd ‘for 


eveluéeting mae. uc ed situation aispley DrEsSentallon 
Teemmiaques. nowever, rege onse times are measurable 








G@@emtities that can be statistically evaluated. Considering 
mae time to enalyze @ tactical Situation, i.e., locate the 
enery, Pandit Importers t. Trliterys/  COnsideratvoa, ~ use “oO. 


response times aS an moe was assumed to be appropriete. 
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FIGURATIVE SYMBOLS 


FRIENDLY AIR 
(BlLue/Green) 


FRIENDLY SURFACE 
(Blue/Green) 


| 


FRIENDLY SUBSURLACE 
(Blue/Green) 


ENEMY AIR 
(Orange/Red) 


ENEMY. SURFACE 
(Orange/Red ) 


ENEMY SUBSURFACE 
(Orange/Red) 


UNKNOWN AIR 
(White) 


UNKNOWN SURFACE 
(White) 





UNKNOWN SUBSCUREACS 
(white) 
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ANN 


ARBOR 


TERMINAL 


O)) 


Hquipment 





CCNRAC 
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Ill. EVALUATION 


A. DATA COLLECTION AND REDUCTICN 

Bom GxXperiment 1, the subjects total response times for 
pop question were processed by a computer program and 
written inte data files. This data was then consclidated 
into a rore readable forrat. Appendix EF contains response 
meaneomorocen dcwh oy treatment, question, and subject. en 
SsOme Taos sSUBEeChS had Glititculty wupderstandine the 
Ouespron. this resulted in an unusually high resronse time. 
iomemoalnr2 ze this ¢kewing effect, these times were discarded 
Muto OonlOWwlneS Manner: the Broup mean tor the other tive 
SUv jects was calculated and inserted in place of the higher 
iwieewmin Arpendix E£ these substitutions are shown 12 
Bememeneses next tc the original respcnse time. 

emt, the data were further aggregated into the three 
categcries of gquestions (type, allegiance, or both) by 
PoGeememernemresponse times for questions ot the same category 
(Figure 5) and tnen dividing by the number of questions that 
were added. This resulted in a mean response time per 


_ 
4 


question and category. These data are shown in Appendix :, 
Teble ¥V in conjunction with means end verlances computed by 
Pome ceuestion, display and treatment. Cuestions are Suown 


in Appendix C. 


Be 
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Pru ewoneoves tl Olea LEZ OrT1leS 


kor experiment <, e@ach subject’s map was sccred by 
Sveeeumae One point for correct identification of symbol type 
ameeome DEINt fcr correct allegiance. Maximum sccre was 
eee e|en in @ach cetegory for @ total of thirty-six points. 


Bemendix G shows the scores. 


B. CALCULATIONS CF MEANS AND VARIANCES 

meeencia = ccntalins the means and Variances Oc == tne 
subjects’ respense times. Tabdle V shows means and variances 
lec rour, question, display and treatrent. Table VI 
ccomtains tne means and variances by question, display and 
treatment. Table VII shows the overall means and variances 
ty question and treatment. sinally, Taole Wri] converse tne 


erend means anda variances by treatment. Means and variances 





were calculated ty using the fcrtran computer prcgram Listed 


Piewppendix &. 


G. aN ALESIS OF BXP 


<4 


RI 


t-4 


teed 

The analysis of data wes aone in two parts. MSG, 
Simple me@an and variance statistics were calculated and 
Sexemimed. Then, analysis ct variance (ANOVA) [Ref. &] was 
ieieiommcO test TOF signiticance of the individual tactors and 
Meampcem imate the eftects ct the aitferent levels 6% tke 


me CCOTrTsS . 


iaeoonparison Of Mean Response Tires 

Comparison of rean response tires canrom be 
Comerecored statistically conclusive because of the large 
veriances invcived. However, ccmparison ct means can give 
one insight into how subjects performances were atfected by 
display treatments. Fcr e€xamp le, Cons aces Table i 
Monochromatic NTIS Display #1. Subjects 1-6 (group A) were 
wamenens display tre€@tment first, while subjects “Y=lz 
(omempes ef) saw it last, subjects 13-18 (group C) saw it 
Peeacemmand it was the seccnd display treatment fer subjects 
16-24 Veron D) . The improvement of group meén times for 
M@testions reterring to syrdol type, Srour A-15.3S seconds, 
masa lec.€’ seconds, group C-1l<.00 seconds, and group B- 
Wee -econds, wctld se€m to indicate the presence of 
tearaine weet tects. Lixewise, consider Tapnle V, Color NTDS 


Display # 1. Craer cf presentaticn was group C (first), 
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oup E (seéconda} SuoOM Pp teeeteird ) Gand moms.» | foumth).. 
Mean tires for allegiance were C-6.82 Secondce. 2—Oa67 
s€conds, A-<.75 seconds, and [-4.5@ seconds. Again, the 
Beeaence Ct learning ettects is imdicated. Examination or 
GiewemecdanS by groups and displey for the same treatment 
megmeate learning ettects tor the majority ot the displays 
eacemauesticns. 

[If imfroverent in response time is due solely to 
Learning Si eCus , than one would exrect to see an 
improvement in the same group’s meén times dependent only on 
Omeer of treatment. Consider group A’s yerformance on 
display number two. Group A first Saw display two in 
Tomcenromatic NiIDS, followed by COLO er tigurative 
(plue/oranese), color NTDS, and finally color figuretive 
(green/rea). Group mean times for type were 22.33 seconds, 
memes seconds, 1lo.cs seconds, and 19.17 seconds. Likewise, 
Gomsider grour G on displey nurber four. Onder “cf 
treatments was cclor NTDS, color figurative (green/reda), 
Tom@enromatic NTDS, and color figurative (blue/oranzge). 
Meemmerrmes fcr type were 17.17 seccnds, 11.67 seconds, lave? 
Seems, mand 140.5¢ seconds. in the majority of displays 20 
weeererrend of imprevemert is evidenced. This suggests ther 
Meemomement in response times is not teased simply on 
hearunt2 e=tects. 


Sumes for eaegch display and treatment, €ech eaoraeeay 


'ct 


Beceem ay at a different point in tneir trials, tne 7veane 


ou 





by question , aispley and treatment should tend to smooth 
Poe Ertects of the groups. Table WV) convains™= ie 
Seecii Means Dy question, aispley and treatment. For 
display one, fonochroratic NTDS had the slowest mean 
response times in all three question categories. Also for 
display one, color tigurative (green/red) had the best times 
scr questicns referring to symbol type and both, and color 
NTDS had the thirc best mean times for type and both. Mean 
mommemse vimes TCr questions referring tc allegiance “Were 
Pesemr.dity the same tor the three color treatrents for all 
displays. Further examination shcws that monochromatic NTDS 
had the slowest mean response time in every case excert one. 
Ccolcr figurative (green/red) had the best time for questions 
referring to symbol type in every case except for one. 

Next, the cverall means by question ard treatment, 
snpown in Table VII, were considered. Now a clearer picture 
begins tec emerge. Colcr tigurative (green/red) is best in 
every category of question. For Questions retrerrigge to 
peace type, Lt 1S 2.49 seccnds better than colcr <sigurative 
Moue, orange), 4.25 seconds better than color NTDS, and 6.3¢ 
Seeemas  DeTter than Monochromatic NIDS. For questions 
memorowme tO allegiance, it 15 94.18 seconds better than 
Peering eurative (blue/orange), @-€1 seccnds ovetter than 
eolor MIDS, and ¢.97 seconds better than monochromatic NTDS. 
Pores questicns referring Le ezom aoe CeLor Ste Rae 


aaeeny rea) is 2.68 séconas better then color figuretive 
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(olue/orange), 9.5% seconds pvetter than color NTDS, ana 2.27 
Becemas CeEtleEr then monecchromatic NIDS. For all categories, 
color tigurative (green/rea) 15 best, followed in order dy 
eicilkc = ro wna vive ( Diwe/ cranae), ec le:, NTDS, and 


Gemocnaromatic NILS. 


rx 


beeily; the grand mean for all grcups;, “auesttens 
and aisplays by treatmrent were calculated. AS Shown in 
Tatle VIII the crder of test response times was the same as 
Saowmeeia the preceding raragrezph. While these reen response 
times have peen used te gain insight into the subjects” 
perrormences, they CEBNCL DeEs= CONSIdEred Stetist tea 
Gorerusive vecause of the variances involved. Also, ettects 
such és learning, des per, difficulty. end previous 
paeeraenecs are not considered. Therefore, a statistically 
Bemorous procedure, eénalysis of Variance, was performed to 
Gemowee tnese other rotentiaily important effects to oe 


ccnsidered. 


e. SWalysis of Veriance 
a. Hypcthesis 

we hypothesized that figurative symbology would 
improve cperator target recognition times. The experiment 
neeeeyeotnesis wees: 

Ho: M1 = Me = ME = M4 

wiere ¢ is the mean question response time and 1-& Tepresent 
TCOC®s morochromratic NTDS, color figurative (dilue/orange), 


cclcr NTDS, end colcr figurative (green/rea), respectively. 
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The alternate hypothesis is implieda--the rean ceSsponse times 
*cor the respective modes are different. 

In aadition to testing our basic hypothesis, We 
ree T ee «as Mieeor lame LO “Vest or “eieniereanuce “or 
rode/displey type interactions and mode/question type 


interactions. 


bh. Model 


Analysis or variance considered the rodel: 
Y(s,d,q)/=M+oX1+bXZ+Ast+Bdt+Cq+Isdt+Isqt+idaq+Rsdq 


where Y(s,d,q) would represent the response to the qta 
question, dth display, and sth mode. M is the mean response 
tire; bXl and bie represent the two covariables learning and 
Peperience; AS is tne main ettect due to modes Bd i¢ the 
[memimeurect, Gue tO display difficulty; Cq is the main errect 
aue mimmomesSvlcn. LOrmat; itd, 1s¢, and Idq represeny 
interactions trom the main ettects; and Hsdq is the residual 
term. The ccvariaoles and the factcrs, display and 
question, were includéa in the model because Of our belief 
that e@ach would affect the response time. Their inclusion 
in the model allows for a reduction of the error Variance 
PemmemuestS of the hypothesis ct interest more valid. 

Pepe riOrriluzan une alidiy ssa Of evar Pamce we 
Gamembeed. tne data *rom the twenty tour sutjects and loaded 


foemareves = nto 4a file on the Navel Fosteredvete Schoo! JE 


) 


) 


2¢33 corputer. The data were loaded into a matrix (144¢x 
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With information including specific response times Eo 
questions, mode type (4 levels), disrlay difficulty (& 
Meets), gtestion format (3 levels), learning covarieole, 
ama tne @xperierce covariable. The APL rpregrar, ANOVA, was 
usé€d to célculate the sums of squares, mean squares, degrees 
of freedom, and the ¥ statistics. The APL program allowed 
Bemeewou first construct the full model as itivstraved 
previcusly and then reauce this model. With each successive 
Mem@uetlOn, we were able tc eliminate a porticn cr the full 
Meter, teSt én kypothesis, and determine how much erfect 
eceommeunagividual factor contributed to the overall model, 
ier, ow much veriability could be attributed to indiviauel 
pieces. 

This model was analyzed to describe all possible 
elements of variability. The following ANCVA table (Figure 
G6; dissects the model, illustrating the contributions of 
Praividual factors. 

ieee sieniticance Levels of The wiaerors 9 aa > 
meadel make it possinle to reject tne null hypcthesis: 

Ho: M1 = Me = MS = M4 

Having estaclished that the main efrects or tne 
model are significant, we can continue to examine the moacel 
Bememehain wolch mode rres@€ntation was best, waleh dispray 
Wee easiest, and draw scme ccenclusions about question 


Saeecorias. 
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| 

| 

| ANCVA 

{ 

| SOURCE De SS MS ‘ 

| 

| 

MCD: As iS 6421.65 kee SS 126.92 
j 

| DISPLAY: Ea 4 6112.66 1eZG ee 76.32 
I 

| QUESTIONS : Ca zZ Seems 2626.46 1351s 
t 

! INTERACTIONS 

| 

| Isd 12 1941.87 £6.76 as 
Isq 5 122¢.2¢ 27% .37 1c iG 
! Idq g Silee7s S2Yy .E2 19.46 
J 

! COVARIABLES 

I 

bX1 it Z£6E.¥z 268 YS Toe 
| bX2 i oes $274.20 163.53 
! 

' RESIDUAL 

t 

! 

| RSdq 1482 2E272 .22 £0.02 

| 

| 

TOs b 1439 64785 .28 

| 


Figure €. ANOVA Results 
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Farareteér estimates (figure 7) were supplied as 
Seereepreduct sof the APL pregram used. Cret*icients ¢cr each 
Reece, Caco display, and each question are osoned. The 
Seememetents in each of these groups have been normalized. 
eeemeacally, the last element in each of the egroups is 
zErc. All cther elemerts ct the respective groups are then 
compared to this zero value. To evaluate these parameters, 
each was compared to tne normalized value. 

snalysis of these parameters indicated that 
Score symbology did significantly better than monochromatic. 
Specifically, the green/rea figurative symbology performed 
DES ty, Cn the average, questions involving monochromatic 
displays tock 5.5 seccnds longer to answer than did those 
uSing tiguretive green/red symbols. (AS indicated earlier, 
questions used for each rode presentation were the same.) 
A@@aytionally, questions of color NTDS displays took almost 2 
seconds longer and questions of figurative blue/orange took 
nS of a second longer. AS a Summary ccmmrent, the 
mewemauive symoclogy yielded significantly better results 
than did monochromatic NTDS, but was only a moaerately 
better performer when cclcr wes adaed. However, it did 
eee eerrorn, the Nibo symbology. 

Ineereverew ing the  ditilculty Set. displays... June 
review of tne varareter estimates inaicates that the é€asiest 
display to respond to was display one (nine targets). Tiare 


mest Geee ti Cult cisplay was display three (twenty-one 


of 





targets). This result seemed somewhat inconsistent oecause 
iispbey three did not have the most targets. However, this 
Geeoreay dlc have highly clustered symbcis, swith some 
overlapping, which made inaiviadual target discrimination 
[emewarrricult. The otner displeys ranked in order of 
eemperieculty accoreing tc number cf targets. 

AS @n add€d oosServation, the taramreters for each 
of the cc-variables (Figure 7) is consistent with expected 
results. Coefficients are negative, which inaicates that an 
Mgpmneual wlth More tactical display experience will answer 
feesteons More avickly. Also, ES individuals were 
Egor ressively expcesed to each otf the modes, learning 


occurréd end responses were quicker. 


PARAMETER ESTIMATES 


! 
| | 
| | 
| Monochromatic Oyo ea 
' Color Figurative (E/0) ene || 
ec. Cee iN wes 1.9184 | 
' Color Figurative (G¢/R) 2.2 | 
| 
| Disvlay 1 -3.1611 | 
nm Utsehey < -1.¢862 | 
ie Dass ic yon 29222. 4 
' Display 4 Q@.y4e7 | 
mois piay 2 o.0 ! 
| 
! Experience =? 6178 -; 
| Learn: 12 =] .¢499 | 
i 
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Cc. summary Of Analysis Or Variance 

Two specific observations can oe made about 
See erinent ihe. Ne oni anmier icy Of “COPGr = Le ciainew's 
Significantly imprevea response times to questions eonout tne 
Situation disrlay. Secona, tigurative symbology pertormea 
cbetter than NTDS symoolcgy. Althcvgn the preportionate 
miemease IS HOT aS Feat, both sets of color figurative 
Symtcicgy performed better than NICS. The vest sertormer was 


the colcr figurative (green/red) mode. 


D. ANALYSIS OF EXPERIMENT & 
1. Comparison of Mean Response Times 
The response scores are shown in Appendix ¢G. Means 
and variances (for n-1 degrees ot treedor) were computed. 
ifeemeerespense scores Tor questions referring to type were: 
POnoOchromatic - 13.94 and color tigurative (green/red) - 
Nite ler « Medes COLeSs SOT allegiance questions Were: 
Wemecmromatic —- 15.42 and figurative - 13.98. Mean total 
Seaemese were: monochrematic — 27.53 and figurative - <cv.2s. 
Meamination of the mean scores indicates no ditferencsce in 
performance between the two treatments. Te. CodsiGm “teers 
observation, an anelysis of variance was performed. 
Bee Andaiysis Of Variance 
gree ype THe S1S 
In this experiment we agein hyrethesizec that 


figurative symbology woula do better than TDS symbology. 
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meee xperiment hypcthesis was: 
HO. tie = (Mle 
te ho LHe Mean response score for sutject’s ability to 
reproduce targets fror a timed display and 1~é represent 
modes monochromatic and color figurative (green/red ). 
db. Analysis Of Vériance 

In doing the analysis on this experinent, we 

Ccensidered the mrcedel: 
Hecdech) =a nm bg onde to) teldaqus Rd 

wnere Y(d,q) would represent the score of subject; oX1 is a 
ecvarlable representing experience; Ad is a main effect due 
memmoce, monochromatic or color figurative green/red; Ba is 
mueroeen, "Er fect due tO question type, either a type target 
questicn cr an allegiance question; and Rsd is tne residual 
ete ie 

Analysis was accomplished with an APL program. 
The aata were loaded into a matrix (48 x 4) with information 
including specific sccres of individuals, mode, aquestion 
category (type or allegiance), and an experience covariable. 
With the APL program, we were adle to structure an ANOVA 
rodel and then, through successive reductions ot the model, 
we were able to determine contributions ct individual 


Pepeers to the total variability within the model. 
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| ANOVA | 

j 
j j 
SOURCE DF SS a 
j j 
j j 
| MONO/COLOR 1 Teo nee 
| ®UESTION 1 Wee eel 
eyo xX 1 18 23 
| Gov 1 il else {res 
meee 1 DUAL 63 299.¢7 
meeeo TAL, 47 32Y9.E1 
eee ee a me a ww a ww wn a nw a wr ww ww www eee =r: 


Figure @. ANOVA Results 
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PI VUre TS. Contains the ANCVA table which 
indicates that none of tne effects within this model were 


Peeumerroant. ihe null hypothesis cannot be rejected. 
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IV. DISCUSSION AND CONCLUSIONS 


Memeo NCLUSICNS 

mals researcn erfort was» directed at determining the 
Hee bet y of P1ZuUrative Bsymoewos, fOr Use in = tactical 
Slvu@olon displays. Results of experiment one confirmed 
the advantage ot using celcr versus Monochromatic displays. 
Additionally, the advantage ot using figurative versus NTDS 
Symbels was Memo msi) CCl nO yee etl Te Nir muro mes. whereas 
emperiment one aadrésséd tasks involving speed of tédrgzet 
heeoeGiticnh, we cenclude that use of cclor figurative 
symbologies in military tactical situation displéeys merits 
further investigation. 

Peperiment two addressed utility of Color versus 
Momechromatic displays in tasks involving memory of target 
iecawleon. Results of experiment two do Net Support use of 
Cower figurative displays “in “Situetions “that Tequige 
remorization ot displays. This result is attributed to the 
redundant coding of the NTIS symbolcgy. Subjects had to 
Mene@rage only symbol shape in order to remember both symbol 
type and allegiance when viewing the mcnechromatic NTDS 
display. Zoe color tigurative symbology required 
@@morizaticn of obcth symbot shape and ccler in crder tc 
remember type and ellegiance. One may postulate that the 


Solent ieurative subjects were actually processing more 





information, i.e., processing more mental bits than those 
that viewed tne monocnromatic disrlays. If true, one covla 
Miempecodwelude that the color figurative test Siro eets “nee to 
Outperrorm the monocnromratic test subiects in order to 
achieve the same mean scores. turther investigation of this 


Permit tty is Vert for future stuay. 


Pees uoSlLCN Of FUTURS SYSTEMS 

MowerTe 15 tne ne@€a tor accurate, up to the minute and 
Sceaeey  cemprehersidle intcermaticn more necessary then in a 
Somer tict Situation. The ability to sort out and interpret 
PeronEmablOn guickly is of the utrost importance. Because of 
the militery’s large date beses, the amount of information 
available to commanders is immense. The use of computer 
eraphics to display data allows the commander to get maximum 
PoLcrmetion. Loe neo tt Oral LOn secon Lent. 1nd 2 hor anc 
display wilt enable the operatcr to assimilate mere data 
mith fer less fatigue. AlSO, the abllity to update the data 
Micampaneousiy On the screen gives the comrander the most 
Climmemt iintormation evellable to eid in his decision—mek ime 
rrocess. [Retf. 9] 

meme noted previously, symrboology used in tactical 
emmem mon cicsplays has been Lifited by tecnnoloey. Bewever, 
the technology now existS to develop computer graphic 


Geecwewer SymocloOgy that can be tailored to meet specific user 


r% 


mencemeremy got *vliy expleit thais capability?  Altacughinet 


MMMerratea Sscecificalily in this tnesis, potential does 


bP 


Cn 





Pearse noOw Cr developing even mcre descriptive symbclogy 
meow as developed by the authors. Just visit your local 
game arcade and take a close lock at the electronic games. 
Tre level of symrbol detail available in these aevices is 
am@ad of most current rilitary display systems. To continue 
to provide commanders with efficient disrley systems, the 
rilitary must take advantage else these advances te 


technology. 
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Per on MeN t QUESTIONS 
Hcw 


How 
How 


many 
many 
many 


air units are displayed? 

Peeemor 7 units are displayed? 

Sem semaines are dis vlay=d? 

Fow many units ere west cf the Enterprise? 

How many enemy air units are displayed? 

Which quadrant has the largest concentration of 
enemy units? 


Bow 
How 
How 
the 


Tany ve TeUntisSeere disuldayed ¢ 

many friendly units are displeyed? 

fidny Enemy Units are th the quadrant witk 
Beedives tee neemunal) LOnmO. EnCTY UWnhets ? 

How many submarines are displayed? 

PoVeidniy “UullvsSedtTesnartinedast Of toe enterprise 
Sle ude tr lend) y Gunwts ¢ 

How many unknown air units ere displayed? 


How many enemy surface units are displayed? 

How many friendly units are displayed? 

HOwmnany eo rlendi unr ts are ine tne quadrant 
Gonualtine toe laregestenumber ct triendiy uvrits? 


Eow many 
How many 


LikiOWwneeuntS are displeyed 7 
ait UNITS apemdusiniay ed. 


How many units are northeast cf the Enterprise 
excividing friendly units? 


How many 
How many 
Bow many 
greatest 
Eow many 
How many 
Hew many 


How many 
How many 


enemy units are displayed? 

friendly air units are displayed? 

Cle Uist Een Uddraat With the 
concentraticn of enemy units? 

unknown surface units are displayed? 
SUUCUu wa Cem Rl tc sdeemai Sp layed’ 

PoLendey sures are vdisplayed / 


Sit cic cmny i inemcGe «Cd iSite aii ed, 6 
Pr Lencnywahiwun tes are wnorta @: the 


Mi GenprL se 7 


How 
How 
HOw 
How 


many 
many 
many 
many 


UEKGHOWR units are disrleyed? 
fplemiweevwesuridee sun? ulsS are @rsplayed ? 

enery surface units are in tne NW quadrant? 
Suomariges are disvlayed? 
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COC eee ieee mncULAT# "ML ANS “AND VARIANCES 


This crogrem calculates means and veriances 
for n=l degrees or treedon. 
eeumbamenn se omc cm. 4,5,4,36) ,cxtpar(4,5,4,3) 
Wecmmeehne me 4 6 Oo stiri. s,s,6),axbar(4,5,3) 
real qvar(4,5 3), op ose ey as dvar(4,5) 
real ee rar ee 
reel mxber(4),mvar(4) 
Pooh csQUaTe, first ,second 
Pee seteemOde,d1iSh,Svey,guec,ercup 
Pttteaete from tile cailed matrix. 

do 12 roae=1,4 

Gea Casp=lyc 

qo le sudj=1,<4 

Recah Ganmay mode, cist,subi,ques}), ques=1,3, 

ecntinue 

continue 

ont Lake 
Calculate the group means and variances 
40 41 mode=1 ,4 
GGmee a sp=l1,2 
dc 48 cues=1,é 


sum=0.a 

do 44 subj=1,24 

sum = sum + array(mcede,disp,subji,ques) 

if(subj .eq. E€)csum(mode,disp,1,ques)=sur 
Nites eed. GJexbar(mode,aisp,1,ques)/=sum/6.¢ 
if(suoj .ea. 6}/sum=G6.0 

if(subi .eq. oe a sie, )ques)=sum 
Megaman. eq. Ize jexDar(mode,disp, 2, ques ;=sum/6.2 
if(supj .eq. 12)sum=0.¥ 

if(suoj .e€q. 18})csum(mode,disp,3,ques)=sum 
iarsubs .2q°. re ae. feiss dues) =—sum7 oc 
Heiseo) .e€@. 1&)sum=0.9 

if(subj .eq. 24)csum(mode,aisp,4,ques)=sum 
if(subj .eq. 2)oxbar(moae, disp,4,ques)=sur/6. 2 
Cen tinue 

Com canine 

Comet Ya 


Cont lave 

a0 45 rode=l1,4 

Gem emeisp=l 5 
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Oras Se C= 4 ike 
first—errey (mode ,disp,sutbj,qves) 
SCO deeeAJodr (MCC erdistiec, ques) 
Cltiomemesa lamers (iret —- Seccnd }**2.? 
cOntinue 
Cvar(mode,cisp,2 wueés )=csyuare/s.2z 
esquaere=2.2 
10 = Sui i- Loy le 
(ioe rasy(mCce, dist, std], gues) 
seccnd=cxtea > mede, dsh po meuie Ss) 
cSdquare=csquare + (first — second) **<.¢ 
continue 
cvar(mcde,disp,<é,ques;=csquare/5.¢ 
escuere=2.2 
Womss. SU0jI=19,2¢ 
imo vw dkravumtoce,disp,sub},cques) 
second=cxder(mede,aisp,4,ques) 
cSquUuare=csauare + (first -— second)**2.¢ 
CCN blaee 
cvar(mode,disp,4,aues)=csquare/5.% 
Continue 
Continue 
Con Tenuec 
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ee 2 mede=1,4¢ 
qimeeerSp=—1l,< 
do 54 ques=1,é 
sSum=<¢.2 
‘inc ee roup—1,4 
sum = sum + csum(moae,disp,grour,cues) 
c omer 1 niume 
asum(mode,aisp,ques )=sum 
qmblar(mome,dis;,ques;=sum/-z4 
csquare=¢.0 
Moe Se Sub Fl <4 
tirst=array(mode,disp,subdj,ques) 
second=axbar‘mcde,disp,cues) 
foe tesesamere + (first — second)**2.2 
Com aie 
avear(mede,cdisp,cues=csquare/zs.¢@ 
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Gems (a mOoge—] ,4 
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do sesmcues=1.45 

sum=sum + csum(mcde,disp,qures) 
continue 
dxbar(roae,cdisr)=sum/7z.2@ 
Cseuare=¢ .u 

AOS Su 0 j=l, 24 

dO,G ime Uues-1€ 
Sirst=array(mede,disp,sucj,ques) 
s€cond=dxder(mode,aisn) 
csSquare—csquare + (first - second)**z<.gZ 
continue 

continue 
dvar(moae,aispj=csquare/71.2 
CCRGleue 
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Cole@reayve Lhe treathent wean & variance. 
dc 62 moce=1,4 

sum = 4.2 

Gemeeaee so 1.,5 

do 67 sudi=l,<e¢ 

GO Gesares= 1,2 
Sum=sum + array(mod2,cisr,sudi,gues} 

Cont iave 

continue 

Gout louc 

mxbar(mcae)=sum/360.2 

G oq iciie — wre 

oe omosp=1,s5 

de 7@ subdj=1,24 

fem aieegues=1.,¢ 
first=array(moae,disp,subj,ques) 
second=mxbar/(mcde) 

cSquére=cSquare + (first - second) **2.2 
CoaT liye 

ccntinue 

continue 

mvar(mode)=csquare/Sby.2 

continue 

Calculate the treatment/question mean & varience. 
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ioe (oe gues=1,3 

sum = 2.2 

SSG ware. = (2.2 

Gon (4 diso=-1,°5 

sum = sum + qgsum(mode,disp,ques} 

Conv inwe 

Weramiumed®,cues) = sum/12¢.¢ 

fo re alsp=1,° 

diemrc Su bj=1,.26 
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iemee e160 . Ziwrive\6,2)disp 
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Meee «CC. 2e ec to 18¢ 
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Maemo ec. 12)20 to i2¢ 
Poem «ed. E)2C te 1S? 
EO. tomes 
Mure g) (Cr 0ar | mece,cis:e,!,ques), ques=1,3) 
ee) cyan imcde dicen, i cues). ques=1,3) 
FO to €4 


meecee,2¢)(cxtar(rodé,dist,2,ques), ques=1,3) 
Moepewen zl /(cvarimede,disp,2z,ques), ques=1,35) 
go to €4 

ene caoar cde aise.2,ques), ques—ieec® 
wmmtenten ei, (cvarimede,disp,$5,ques), ques=1,2) 
G0 to C4 


write(6,2¢@)(cxoar(mrode,aisr,4,ques), ques=1,3) 

write(€,Z21)})(cvar(mode,disp,4,ques), ques=1,3) 
continue 

write(4,<2)(qxbar(rode,aisz,ques), ques=1,3) 

wlte(cyeo)(avar(ncde,disp,ques), aques=1,3) 

mete CC é,24)axber(mode, aisp) 

write(S, 25)avar(mede,aisz) 

continue 

continue 

Gor (r dist=1,5 

write(&,125) 

wirite(e€,126) 

Win TES. Sc) 

write(6,63)dai isp 

write(é, 4) 
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Pulte VC ye) (Gwerimode,disr,ques), ques=1,3) 
continue 
Got ave 
ene Ses) 
WELbe(c, te ) 
vrite(=,S20) 
Pees mes) 
ac Jo noce—1,4 
it(mode .eq. 1)write(E,Zs) 
ir(mode .eq. z)write (6 136) 
ie nicdowred wacom Tre (6,57 } 
ifG@mode .eq. Bywrite(é Ze) 
write(5,29)(txbar(moae,qgues), que 
write(€,4@)(tvar(mede,ques,, ques 
continue 
Wipes. 135) 
Peeve, le ) 
Peehe Ge cc ) 
PeeiepTe lO, cr } 
do ¥Y? rede=1,4 
ifimode .e€q. i)write(t,ce)rxdar(rode) ,rvar(moae) 
it(mode .eq. 2jwrite(6,29)mxbdar(mode) ,mvar(mode) 
ifimede .eq. S)write(€,30)mxbar(mcde) ,mvar (mede) 
if(mode .eq. 4)write(6,21)mxbar(mode) ,mvar(mode) 
Com awe 
ScD 
Formatic(feé Za 
moment tk ip ieee APN D lke“, 7 ) 
format(1x, TABLE Vier.) 
Hormmev cae FABLE Vi~,/) 
mommat im, LABLS VI1",/) 
mommatwit, TARLE VIIT*,/ 
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re 
format(1x, MEAN AND VARIANCE BY GROUP, CUESTION, 
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aceieeat lis COLGR FIGURATIVE (GREEN/RED) DISPLAY # ;,i2) 
mommat ie, SUBJECT ,t24, TYPE’ ,tZ8&, ALLEGIANCE ,tS6, 
Sete 7} 

mere re tee at (.c toe, twee, toast? sc) 

sem mat i/.ix, G2CUP MEAN ee. 2, toon Ces ae eee 
femmet (1x, GRCUF VaRIANCE=“t2z, Wee TS ene oe ete, £7. ey 
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forrat(ix, DISPLAY MEAN »UEc,E fe) 

SCmne wl x. DISPLAY VARIANCE = Gxt tees 
famet.///.,1x, MSAN AND VARIANCE BY TREATMENT ',/ 
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Coo rma, /,1%, MEAN AND VARIANCE BY CUESTION, 

DISPLAY, AND TREA 
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Tema wee, Nowe ToS TYPs t42 "AL DecIANCe tS6é EOTH ) 
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Sonim, COLOR PIGURATIVE (GCREBNVRED, ) 
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40 f#ormat(ix, VARIANCE =e Geer Va 7 ot oe) 
SUG fortmati777,1%, MSAN AND VARLANCE BY 
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CUESTICN AND TREATMENT’ ,// 
end 
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